Entropy production fluctuation theorem and the nonequilibrium work relation for free 

energy differences 



On 
On 
On 



Department of Chemistry, 



Gavin E. Crooks* 
University of California at 
(February 1, 2008) 



, Berkeley, CA 94720 



There are only a very few known relations in statistical dynamics that are valid for systems driven 
arbitrarily far-from-equilibrium. One of these is the fluctuation theorem, which places conditions 
on the entropy production probability distribution of nonequilibrium systems. Another recently 
discovered far-from-equilibrium expression relates nonequilibrium measurements of the work done 
on a system to equilibrium free energy differences. In this paper, we derive a generalized version of 
the fluctuation theorem for stochastic, microscopically reversible dynamics. Invoking this generalized 
theorem provides a succinct proof of the nonequilibrium work relation. 
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I. INTRODUCTION 

Consider some finite classical system coupled to a con- 
stant temperature heat bath, and driven out of equilib- 
rium by some time-dependent work process. Most rela- 
tions of nonequilibrium statistical dynamics that are ap- 
plicable to systems of this sort are valid only in the linear, 
near-equilibrium regime. One group of exceptions is the 
entropy production fluctuation theorems which 
are valid for systems perturbed arbitrarily far away from 
equilibrium. Although the type of system, range of appli- 
cability, and exact interpretation differ, these theorems 
have the same general form, 



(1) 



Here P(+cr) is the probability of observing an entropy 
production rate, <r, measured over a trajectory of time t. 
Evans and Searles |^] gave a derivation for driven ther- 
mostated deterministic systems that are initially in equi- 
librium, Gallavotti and Cohen || rigorously derived 
their fluctuation theorem for thermostated determinis- 
tic steady state ensembles, and Kurchan ||, Lebowitz 
and Spohn O], and Maes have considered systems 
with stochastic dynamics. The exact interrelation be- 
tween these results is currently under debate 

In this paper we will derive the following, somewhat 
generalized, version of this theorem for stochastic micro- 
scopically reversible dynamics: 



Pf(+^) 
Pr(-w) 



(2) 



Here u is the entropy production of the driven system 
measured over some time interval, Pf(w) is the proba- 
bility distribution of this entropy production, and Pr(w) 



is the probability distribution of the entropy production 
when the system is driven in a time-reversed manner. 
This distinction is necessary because we will consider sys- 
tems driven by a time-dependent process, rather than the 
steady perturbation considered elsewhere. The use of an 
entropy production, rather than an entropy production 
rate, will prove convenient. 

As a concrete example of a system for which the above 
theorem is valid, consider a classical gas confined in a 
cylinder by a movable piston. The walls of this cylin- 
der are diathermal so that the gas is in thermal contact 
with the surroundings, which therefore act as the con- 
stant temperature heat bath. The gas is initially in equi- 
librium with a fixed piston. The piston is then moved 
inwards at a uniform rate, compressing the gas to some 
new, smaller volume. In the corresponding time-reversed 
process, the gas starts in equilibrium at the final volume 
of the forward process, and is then expanded back to the 
original volume at the same rate that it was compressed 
by the forward process. The microscopic dynamics of the 
system will differ for each repetition of this process, as 
will the entropy production, the heat transfer, and the 
work performed on the system. The probability distri- 
bution of the entropy production is measured over the 
ensemble of repetitions. 

Another expression that is valid in the far-from- 
equilibrium regime is the recently discovered relationship 
between the difference in free energies of two equilibrium 
ensembles, AF, and the amount of work, W , expended in 
switching between ensembles in a finite amount of time 



-/3W\ _ C -/3AF 



(3) 
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Here f3 = is the Boltzmann constant, T is the 

temperature of the heat bath that is coupled to the sys- 
tem, and (• • •} indicates an average over many repetitions 
of the switching process. For the confined gas considered 
above, the free energy depends on the position of the 
piston. With Eq. (Q), we can calculate the free energy 
change when the system is compressed to a new volume 
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by making many measurements of the work required to 
effect the change, starting each time from an equilibrated 
system, and taking the above average. In the limit of in- 
stantaneous switching between ensembles, this relation 
is equivalent to the standard thermodynamic perturba- 
tion method used to calculate free energy differences with 
computer simulations J20 - 23 . 

Equations (|J) and (p^are actually closely related. We 
first note that whenever Eq. ^ is valid, the following 
useful relation holds || Eq. (16)]: 



/+oo r+oo 
P F (+w)e~ w dcj = / P K (-w)du 
-oo J — oo 



1. 



(4) 



We shall show in Sec. Ill that the generalized fluctuation 
theorem, Eq. (||), can be applied to systems that start 
in equilibrium, and that the entropy production u) for 
such systems is —j3AF + j3W . The nonequilibrium work 
relation for the free energy change, Eq. (H|), can thus 
be derived by substituting this definition of the entropy 
production into Eq. (Q), and noting that the free energy 
difference is a state function, and can be moved outside 
the average. 

In the following section we will derive the fluctuation 
theorem, Eq. (g). Then in Sec. Ill we will discuss two 



distinct groups of driven systems for which the theorem 
is valid. In the first group, systems start in equilibrium, 
and are then actively perturbed away from equilibrium 
for a finite amount of time. In the second group, systems 
are driven into a time symmetric nonequilibrium steady 
state. We conclude by discussing several approximations 
that are valid when the entropy production is measured 
over long time periods. The fluctuation theorem and its 
approximations are illustrated with data from a simple 
computer model. 



II. THE FLUCTUATION THEOREM 

As indicated in the Introduction, we consider finite, 
classical systems coupled to a heat bath of constant tem- 
perature, T = 1//3. (All entropies are measured in nats 
p4| , so that Boltzmann's constant is unity.) The state 
of the system is specified by x and A, where x repre- 
sents all the dynamical, uncontrolled degrees of freedom, 
and A is a controlled, time-dependent parameter. For 
the confined gas considered in the Introduction, the heat 
bath is simply the walls of the cylinder, the state vector 
x specifies the positions and momenta of all the parti- 
cles, and A specifies the current position of the piston. 
In computer simulations, the controlled parameter could 
be a microscopic degree of freedom. For example, in a 
free energy calculation A could specify the distance be- 
tween two particles or the chemical identity of an atom 
or molecule 

A particular path through phase space will be speci- 
fied by the pair of functions (x(f),A(£)). It will prove 



convenient to shift the time origin so that the paths un- 
der consideration extend an equal time on cither side 
of that origin, t G {— t, +t} or t £ {— oo, +oo}. Then 
the corresponding time reversed path can be denoted 
as \x{— t)i A(— t)j. The overbar indicates that quanti- 
ties odd under a time reversal (such as momenta or an 
external magnetic field) have also changed sign. 

The dynamics of the system are required to be stochas- 
tic and Markovian j p5[ . The fluctuation theorem was 
originally derived for thermostated, reversible, determin- 
istic systems (^||. However, there are fewer technical 
difficulties if we simply assume stochastic dynamics 
We will also require that the dynamics satisfy the follow- 
ing microscopically reversible condition: 



V[x(+t)\X{+t)} 
V[x(-t)\X(-t)] 



exp 



{-(3Q[x(+t),\(+t)]}. (5) 



Here 7- , [x(+i)|A(+i)] is the probability, given X(t), 
of following the path x(t) through phase space, and 
V\x(— i), |A(— t)] is the probability of the corresponding 
time-reversed path. Q is the heat, the amount of energy 
transferred to the system from the bath. The heat is a 
functional of the path, and odd under a time reversal, 
le.,Q[x(t),X(t)]=-Q[x(-t),X(-t)]. _ 

In current usage, the terms "microscopically re- 
versible" and "detailed balance" are often used inter- 
changeably [ p6| . However, the original meaning of micro- 
scopic reversibility |]27| , p8f is similar to Eq. (||). It relates 
the probability of a particular path to its reverse. This 
is distinct from the principle of detailed balance |p6| , pl| , 
which refers to the probabilities of changing states with- 
out reference to a particular path. It is the condition 
that P(A — ► B) = P(B — ► A) exp(-/3AE), where AE 
is the difference in energy between state A and state B, 
and P(A — ► B) is the probability of moving from state 
A to state B during some finite time interval. 

The stochastic dynamics that are typically used to 
model reversible physical systems coupled to a heat 
bath, such as the Langevin equation and Metropolis 
Monte Carlo, are microscopically reversible in the sense 
of Eq. (jsj) . Generally if the dynamics of a system obey 
detailed balanced locally in time (i.e. each time step is 
detailed balanced) then the system is microscopically re- 
versible even if the system is driven from equilibrium by 
an external perturbation | fl9| Eq (9)]. 

A particular work process is defined by the phase- 
space distribution at time — r, p(x_ r ), and the value of 
the control parameter as a function of time, A(i). Each 
individual realization of this process is characterized by 
the path that the system follows through phase space, 
x(t). The entropy production, lu, must be a functional 
of this path. Clearly there is a change in entropy due 
to the exchange of energy with the bath. If Q is the 
amount of energy that flows out of the bath and into 
the system, then the entropy of the bath must change 
by —ftQ- There is also a change in entropy associated 
with the change in the microscopic state of the system. 
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From an information theoretic J24] perspective, the en- 
tropy of a microscopic state of a system, s(x) = — lnp(x), 
is the amount of information required to describe that 
state given that the state occurs with probability p{x). 
The entropy of this (possibly noncquilibrium) ensemble 
of systems is S — — ^2, x p(x)hip{x). Thus, for a single 
realization of a process that takes some initial probabil- 
ity distribution, p(x^-), and changes it to some different 
final distribution, p(x +T ), the entropy production |29|] is 



lu = \np{x^ T ) — ln/?(x +T ) — f3Q[x(t), \(t)} 



(6) 



This is the change in the amount of information required 
to describe the microscopic state of the system plus the 
change in entropy of the bath. 

Recall that the fluctuation theorem, Eq. (|J), compares 
the entropy production probability distribution of a pro- 
cess with the entropy production distribution of the cor- 
responding time-reversed process. For example, with the 
confined gas we compare the entropy production when 
the gas is compressed to the entropy production when 
the gas is expanded. To allow this comparison of forward 
and reverse processes we will require that the entropy 
production is odd under a time reversal, i.e., wf = -wr, 
for the process under consideration. This condition is 
equivalent to requiring that the final distribution of the 
forward process, p F (x +T ), is the same (after a time rever- 
sal) as the initial phase-space distribution of the reverse 
process, p n (x +T ), and vice versa, i.e., p F (x +T ) = p R (a; +r ) 
and p n (x^r) — p F (x^r). In the next section, we will dis- 
cuss two broad types of work process that fulfill this con- 
dition. Either the system begins and ends in equilibrium 
or the system begins and ends in the same time symmet- 
ric nonequilibrium steady state. 

This time-reversal symmetry of the entropy production 
allows the comparison of the probability of a particular 
path, x(t), starting from some specific point in the initial 
distribution, with the corresponding time-reversed path, 

p w (x. T )r[x(+t)\\(+t)} = e+UF 

P Jx +T )V[x(-t)\X(-t)] 

This follows from the the conditions that the system is 
microscopically reversible, Eq. (|^) and that the entropy 
production is odd under a time reversal. 

Now consider the probability, Pf(w), of observing a 
particular value of this entropy production. It can be 
written as a d function averaged over the ensemble of 
forward paths, 

P F (w)= (*(w-wf)} p 

p F (x^-)V[x(+t)\X(+t)]S (lo -lof)T> [x(t)]dx- T dx +T . 

-T 

Here JJJ^ T ■ ■ ■ V[x(t)]dx- T dx +T indicates a sum or suitable 
normalized integral over all paths through phase space, 
and all initial and final phase space points, over the ap- 
propriate time interval. We can now use Eq. (Q) to con- 
vert this average over forward paths into an average over 
reverse paths. 



^)=Jjj7Mr)V[x{-t)\X{-t)] X 

8 ( lu - wf ) e + " F T> [x ( t ) ] dx- T dx +T 

fx +T _ 
p R {x +T )V[x(-t)\X(-t)} x 

5 ( lu + wp. ) V [x ( t ) ] dx _r dx +T 

= e+" (%+w R )> R 
= e +w P R (-u;). 

The 5 function allows the e +UJ term to be moved out- 
side the integral in the second line above. The remaining 
average is over reverse paths as the system is driven in 
reverse. The final result is the entropy production fluc- 
tuation theorem, Eq. (|^). 

The theorem readily generalizes to other ensembles. As 
an example, consider an isothermal-isobaric system. In 
addition to the heat bath, the system is coupled to a vol- 
ume bath, characterized by [3p, where p is the pressure. 
Then the microscopically reversible condition, Eq. (||), 
becomes 



V[x(+t)\X(+t)] 
V[x(-t)\X(-t)} 



exp 



{-(3Q[x(t),X(t)} 

-(3pAV[x(t),X(t)}}. 



Both baths are considered to be large, equilibrium, ther- 
modynamic systems. Therefore, the change in entropy 
of the heat bath is — j3Q and the change in entropy of 
the volume bath is — (3pAV, where AV is the change in 
volume of the system. The entropy production should 
then be defined as 



lu = In p(x_ T ) — hip(x +T ) — (3Q — /3pAV. 



(8) 



The fluctuation theorem, Eq. (|2|), follows as before. It is 
possible to extend the fluctuation theorem to any stan- 
dard set of baths, so long as the definitions of microscopic 
reversibility and the entropy production are consistent. 
In the rest of this paper we shall only explicitly deal with 
systems coupled to a single heat bath, but the results 
generalize directly. 



III. TWO GROUPS OF APPLICABLE SYSTEMS 

In this section we will discuss two groups of systems 
for which the entropy fluctuation theorem, Eq. (||), is 
valid. These systems must satisfy the condition that the 
entropy production, Eq. (^J) , is odd under a time reversal, 
and therefore that p F (x +T ) = P r (^+t)- 

First consider a system that is in equilibrium from time 
t = —oo to t = —t. It is then driven from equilibrium by 
a change in the controlled parameter, A. The system is 
actively perturbed up to a time t = +r, and is then al- 
lowed to relax, so that it once again reaches equilibrium 
at t = +oo. For the forward process the system starts in 
the equilibrium ensemble specified by A(— oo), and ends 
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FIG. 1. A very simple Metropolis Monte Carlo simulation 
is used to illustrate the fluctuation theorem and some of its 
approximations. The master equation for this system can be 
solved, providing exact numerical results to compare with the 
theory. A single particle occupies a finite number of posi- 
tions in a one-dimensional box with periodic boundaries, and 
is coupled to a heat bath of temperature T = 5. The energy 
surface, E(x), is indicated by - in the figure. At each discrete 
time step the particle attempts to move left, right, or stay put 
with equal probability. The move is accepted with the stan- 
dard Metropolis acceptance probability p% . Every eight time 
steps, the energy surface moves right one position. Thus the 
system is driven away from equilibrium, and eventually set- 
tles into a time symmetric nonequilibrium steady-state. The 
equilibrium (o) and steady state (•) probability distributions 
are shown in the figure above. The steady state distribution 
is shown in the reference frame of the surface. 

in the ensemble specified by A(+oo). In the reverse pro- 
cess, the initial and final ensembles are exchanged, and 
the entropy production is odd under this time reversal. 
The gas confined in the diathermal cylinder satisfies these 
conditions if the piston moves only for a finite amount of 
time. 

At first it may appear disadvantageous that the en- 
tropy production has been defined between equilibrium 
ensembles separated by an infinite amount of time. How- 
ever, for these systems the entropy production has a sim- 
ple and direct interpretation. The probability distribu- 
tions of the initial and final ensembles are known from 
equilibrium statistical mechanics: 



Pcq(x\X) 



-pE{x,\) 



= exp{/?F(/3,A) -f3E(x,X)}. 



(9) 



The sum is over all states of the system, and F(/3, A) = 
—f3~ 1 ln^x ex P{ — (3E(x, A)} is the Helmholtz free energy 
of the system. If these probabilities are substituted into 
the definition of the entropy production, Eq. (^), then we 
find that 



uj f = -(3AF + /3W. 



(10) 



Here W is the work and we have used the first law of 
thermodynamics, AE = W + Q. 
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FIG. 2. Work probability distribution ( — ) for the system 
of Fig. |l| starting from equilibrium. The work W was mea- 
sured over 16, 32, 64, 128, and 256 cycles (At = 128, 256, 512, 
1024, and 2048). For each of these distributions the work fluc- 
tuation theorem, Eq. (|ll]), is exact. The dashed lines ( ) 

are Gaussians fitted to the means of the distributions for At = 
256 and 1024. (See Sec. |[v|). 



It is therefore possible to express the fluctuation the- 
orem in terms of the amount of work performed on a 
system that starts in equilibrium |50l , 



P F (+pW) 



e -AF e +/W 



(11) 



The work in this expression is measured over the finite 
time that the system is actively perturbed. We have now 
established the fluctuation theorem for systems that start 
in equilibrium, and have shown that the entropy produc- 
tion is simply related to the work and free energy change. 
Therefore, we have established the nonequilibrium work 
relation, Eq. (||), discussed in the Introduction. 

The validity of this expression can be illustrated with 
the very simple computer model described in Fig. [|. Al- 
though not of immediate physical relevance, this model 
has the advantage that the entropy production distribu- 
tions of this driven nonequilibrium system can be cal- 
culated exactly, apart from numerical roundoff error. 
The resulting work distributions are shown in Fig. ||. 
Because the process is time symmetric, AF = and 
P(+(3W) = P(-/3W)expf3W. This expression is exact 
for each of the distributions shown, even for short times 
when the distributions display very erratic behavior. 

Systems that start and end in equilibrium are not the 
only ones that satisfy the fluctuation theorem. Consider 
again the classical gas confined in a diathermal cylin- 
der. If the piston is driven in a time symmetric periodic 
manner (for example, the displacement of the piston is 
a sinusoidal function of time), the system will eventually 
settle into a nonequilibrium steady-state ensemble. We 
will now require that the dynamics are entirely diffusive, 
so that there are no momenta. Then at any time that 
X(t) is time symmetric, then the entire system is invari- 
ant to a time-reversal. We start from the appropriate 
nonequilibrium steady-state, at a time symmetric point 
of A(i), and propagate forward in time a whole number of 



4 



0.06 




-8 8 16 -/5g 24 

FIG. 3. Heat probability distribution ( — ) for the nonequi- 
librium steady state. The model described in Fig. |l| was re- 
laxed to the steady state, and the heat Q was then measured 
over 16, 32, 64, 128 and 256 cycles (At = 128, 256, 512, 1024, 
and 2048). Note that for long times the system forgets its 
initial state and the heat distribution is almost indistinguish- 
able from the work distribution of the system that starts in 
equilibrium. 



I Af = 128 






Af =256 


Af =512 


Af = 1024 
J- — 








At =2048 







8 16 24 PQ 32 

FIG. 4. Deviations from the heat fluctuation theo- 
rem, Eq. (|l3|), for the distributions of Fig. |^. If 
the heat fluctuation theorem were exact, then the ratio 
r = PQ/\n[P{+(3Q)/P(-PQ)] would equal 1 for all \j3Q\. For 
short times (At < 256) the fluctuation theorem is wholly in- 
accurate. For times significantly longer than the relaxation 
time of the system (At ~ 100), the fluctuation theorem is 
accurate except for very large values of \/3Q\. 



cycles. The corresponding time reversed process is then 
identical to the forward process, with both starting and 
ending in the same steady state ensemble. The entropy 
production for this system is odd under a time reversal 
and the fluctuation theorem is valid. 

As a second example, consider a fluid under a con- 
stant shear |Q. The fluid is contained between parallel 
walls which move relative to one another, so that X(t) 
represents the displacement of the walls. Eventually the 
system settles into a nonequilibrium steady state. A time 
reversal of this steady-state ensemble will reverse all the 
velocities, including the velocity of the walls. The result- 
ing ensemble is related to the original one by a simple re- 
flection, and is therefore effectively invariant to the time 
reversal. Again, the forward process is identical to the 
reverse process, and the entropy production is odd under 
a time reversal. 

In general, consider a system driven by a time symmet- 
ric, periodic process. [A(£) is a periodic, even function 
of time.] We require that the resulting nonequilibrium 
steady-state ensemble be invariant under time reversal, 
assuming that we pick a time about which X(t) is also 
symmetric. This symmetry ensures that the the forward 
and reverse process are essentially indistinguishable, and 
therefore that the entropy production is odd under a time 
reversal. It is no longer necessary to explicitly label for- 
ward and reverse processes. Pf(&0 = Pr(w) = P(w). For 
these time symmetric steady-state ensembles the fluctu- 
ation theorem is valid for any integer number of cycles, 
and can be expressed as 



P(+") 
P(-uj) 



(12) 



For a system under a constant perturbation (such as the 
sheared fluid) this relation is valid for any finite time 
interval. 



IV. LONG TIME APPROXIMATIONS 

The steady-state fluctuation theorem, Eq. (|l2|), is for- 
mally exact for any integer number of cycles, but is of lit- 
tle practical use because, unlike the equilibrium case, we 
have no independent method for calculating the probabil- 
ity of a state in a nonequilibrium ensemble. The entropy 
production is not an easily measured quantity. However, 
we can make a useful approximation for these nonequilib- 
rium systems which is valid when the entropy production 
is measured over long time intervals. 

From the relation (exp(— u>)) = 1, Eq. (||), and the 
inequality (cxpa;) > exp(cc), which follows from the con- 
vexity of e x , we can conclude that (ui) > 0. On av- 
erage the entropy production is positive. Because the 
system begins and ends in the same probability distri- 
bution, the average entropy production depends only 
on the average amount of heat transferred to the bath. 
— (u) = (PQ) < 0. On average, over each cycle, energy 
is transferred through the system and into the heat bath 
(Clausius inequality). The total heat transferred tends to 
increase with each successive cycle. When measurements 
are made over many cycles, the entropy production will 
be dominated by this heat transfer and u> rj —f3Q. There- 
fore, in the long time limit the steady state fluctuation 
theorem, Eq. (|12|), can be approximated as 



(13) 



Because — j3Q is the change in entropy of the bath, this 
heat fluctuation theorem simply ignores the relatively 
small, and difficult to measure microscopic entropy of 
the system. 

Heat distributions for the simple computer model of a 
nonequilibrium steady state are shown in Fig. ||, and the 
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FIG. 5. Work distribution ( — ) and Gaussian approxima- 
tion ( ) for At =2048, with the probabilities plotted on a 

logarithmic scale. The Gaussian is fitted to the mean of the 
distribution and has a variance half the mean (see Sec. 0). 
This Gaussian approximation is very accurate, even to the 
very wings of the distribution, for times much longer than 
the relaxation time (At » 100) of the system. This same 
distribution is shown on a linear scale in Fig. ^[ 



validity of the above approximation is shown in Fig. 
As expected, the heat fluctuation theorem, Eq. (|13|), is 
accurate for times much longer than the relaxation time 
of the system. 

Another approximation to the entropy production 
probability distribution can be made in this long time 
limit. For long times the entropy production u> is the 
sum of many weakly correlated values and its distribu- 
tion should be approximately Gaussian by the central 
limit theorem. If the driving process is time symmet- 
ric, then Pf(w) = Pr(w) = P(w), and the entropy pro- 
duction distribution is further constrained by the fluc- 
tuation theorem itself. The only Gaussians that satisfy 
the fluctuation theorem have a variance twice the mean, 
2(uj) = ((u — (uj)) 2 y This is a version of the standard 
fluctuation-dissipation relation pj] ]. The mean entropy 
production (dissipation) is related to the fluctuations in 
the entropy production. If these distributions are Gaus- 
sian, then the fluctuation theorem implies the Green- 
Kubo relations for transport coefficients How- 
ever, we have not used the standard assumption that the 
system is close to equilibrium. Instead, we have assumed 
that the system is driven by a time symmetric process, 
and that the entropy production is measured over a long 
time period. 

Gaussian approximations are shown in Figs. || and |B| 
for the work distribution of the simple computer model. 
For times much longer than the relaxation time of the 
system these approximations are very accurate, even in 
the wings of the distributions. This is presumably due 
to the symmetry imposed by the fluctuation theorem. 
For a nonsymmetric driving process, this symmetry is 
broken, and the distributions will not necessarily satisfy 
the fluctuation-dissipation relation in the long time limit. 
For example, see Fig. 8 of Ref. |16[j . Clearly these dis- 
tributions will be poorly approximated by the Gaussian 
distributions considered here. 



V. SUMMARY 

The fluctuation theorem, Eq. (||), appears to be very 
general. In this paper we have derived a version that 
is exact for finite time intervals, and which depends on 
the following assumptions; the system is finite and clas- 
sical, and coupled to a set of baths, each characterized 
by a constant intensive parameter. The dynamics are re- 
quired to be stochastic, Markovian, and microscopically 
reversible, Eq. (^), and the entropy production, defined 
by Eq. (|6|), must be odd under a time reversal. This 
final condition is shown to hold for two broad classes 
of systems, those that start in equilibrium and those in 
a time symmetric nonequilibrium steady state. For the 
latter systems the fluctuation theorem holds for entropy 
productions measured over any integer number of cycles. 
This generality, and the existence of the nonequilibrium 
work relation discussed in the Introduction, suggests that 
other nontrivial consequences of the fluctuation theorem 
are awaiting study. 
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